Risk-sensitive semi-Markov decision processes with general utilities and multiple criteria

JOURNAL ARTICLE published September 2018 in Advances in Applied Probability

Authors: Yonghui Huang | Zhaotong Lian | Xianping Guo

Semi-Markov Decision Processes

BOOK CHAPTER published in Advances in Mechanics and Mathematics

Time-average optimal constrained semi-Markov decision processes

JOURNAL ARTICLE published June 1986 in Advances in Applied Probability

Authors: Frederick J. Beutler | Keith W. Ross

Absorbing Continuous-Time Markov Decision Processes with Total Cost Criteria

JOURNAL ARTICLE published June 2013 in Advances in Applied Probability

Authors: Xianping Guo | Mantas Vykertas | Yi Zhang

On the structure of semi-Markov processes

JOURNAL ARTICLE published June 1975 in Advances in Applied Probability

Authors: Erhan Çinlar

Filtering of Markov renewal queues, III: semi-Markov processes embedded in feedback queues

JOURNAL ARTICLE published June 1984 in Advances in Applied Probability

Authors: Jeffrey J. Hunter

An invariance principle for semi-Markov processes

JOURNAL ARTICLE published March 1985 in Advances in Applied Probability

Authors: D. McDonald

Limit theorems for α-recurrent semi-Markov processes

JOURNAL ARTICLE published September 1976 in Advances in Applied Probability

Authors: Esa Nummelin

On the limiting distribution of generalized semi-Markov processes

JOURNAL ARTICLE published June 1976 in Advances in Applied Probability

Authors: R. Schassberger

Limit theorems for semi-Markov processes and renewal theory for Markov chains on general state spaces

JOURNAL ARTICLE published June 1978 in Advances in Applied Probability

Authors: K. B. Athreya | P. Ney

Sufficient statistics for Markov decision processes

JOURNAL ARTICLE published June 1978 in Advances in Applied Probability

Authors: J. A. Bather

On a fundamental identity in the theory of semi-Markov processes

JOURNAL ARTICLE published August 1972 in Advances in Applied Probability

Authors: E. Arjas

Event coupling and performance sensitivity analysis of generalized semi-Markov processes

JOURNAL ARTICLE published September 1995 in Advances in Applied Probability

Authors: Xi-Ren Cao

Insensitive average residence times in generalized semi-Markov processes

JOURNAL ARTICLE published December 1981 in Advances in Applied Probability

Authors: A. D. Barbour | R. Schassberger

General optimal stopping theorems for semi-Markov processes

JOURNAL ARTICLE published December 1993 in Advances in Applied Probability

Authors: Frans A. Boshuizen | José M. Gouweleeuw

Insensitivity of steady-state distributions of generalized semi-Markov processes by speeds

JOURNAL ARTICLE published December 1978 in Advances in Applied Probability

Authors: R. Schassberger

Successive approximations for Markov decision processes

JOURNAL ARTICLE published June 1978 in Advances in Applied Probability

Authors: J. A. E. E. Van Nunen

Aggregated semi-Markov processes incorporating time interval omission

JOURNAL ARTICLE published December 1991 in Advances in Applied Probability

Authors: Frank Ball | Robin K. Milne | Geoffrey F. Yeo

Recurrence criteria for multi-dimensional Markov chains and multi-dimensional linear birth and death processes

JOURNAL ARTICLE published March 1976 in Advances in Applied Probability

Authors: Harry Kesten

Impulsive Control for Continuous-Time Markov Decision Processes

JOURNAL ARTICLE published March 2015 in Advances in Applied Probability

Authors: François Dufour | Alexei B. Piunovskiy